GROUND STATES FOR PSEUDO-RELATIVISTIC HARTREE 
EQUATIONS OF CRITICAL TYPE 
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Abstract. We study the existence of ground state solutions for a class of 
non- linear pseudo-relativistic Schrodinger equations with critical two-body 
interactions. Such equations are characterized by a nonlocal pseudo-differential 
operator closely related to the square-root of the Laplacian. We investigate 
such a problem using variational methods after transforming the problem to 
an elliptic equation with a nonlinear Neumann boundary conditions. 



1. Introduction 

The relativistic Hamiltonian for N identical particles of mass m, position Xi and 
momentum pi interacting through the two body potential Q;M^(|xi — Xj\) is given 
by 

N , 

H = ^{^J pjc^ + m^d^ - mc^) -a^W{\x, - Xj\). 

1=1 i^j 

where c is the speed of light and a > is a coupling constant. 

According to the usual quantization rules the dynamics of the corresponding 
system of A''-identical quantum spinless particles (a Base gas) is described by the 
complex wave function 5' at = 5'Ar(t, xi, . . . , xat) governed by the Schrodinger equa- 
tion 

where h is the Planck's constant. Here Hn-T) <Z L'^{B?)®^'^ L'^{R^)'^-'^ is the 
quantum mechanics Hamiltonian operator, obtained from the classical Hamiltonian 
with the usual quantization rule p i— > — i?iV, and defined in a suitable dense domain 
v. In the case we are interested inHN is 

N N 

Un = ^-h^c:^^.j + m2c4 - mc^) ~ a^W{\xi - Xj\). 

where W is the multiplication operator corresponding to the two body interaction 
potential, (e.g. Vl^(|a;|) — \x\~^ for gravitational interactions) . 
The operator (from now on we will take h = 1, c — \) 



(1.1) V-A + m? 

can be defined for all / G H^{R^) as the inverse Fourier transform of the 

function \J \k\^ + m?F[f]{k) (here J-[f] denotes the Fourier transform of /) and it 
is also associated to the quadratic form 

Q(/,5)= / ^\k\^ +m^F[}]F[g] dk 
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which can be extended to the space 

H'^\R^) = {f eL^{m^)\ f \k\\T[f]{k)f dk < +00} 

(see e.g. [TOl for more details). 

In the mean field limit approximation (i.e. aN ~ 0{1) a.s N ^ +00) of a 
quantum relativistic Bose gas, one is lead to study the nonlinear mean field equation 
— called the pseudo-relativistic Hartree equation — given by 

(1.2) idttp = ( V-A + m2 - m)ij - (V7 * \^p\^)^. 

where * denotes convolution. We will take attractive two body interaction, and 
hence W will always be a nonnegative function. 

See [TT] for the study of this equation when W is the gravitational interaction, 
and [3] for a rigorous derivation of the mean field equation (|1.2p as a limit as 
N — >■ +00 of the Schrodinger equation for N quantum particles, and [5] for more 
recent development on models involving the pseudorclativistic operator A + m?. 

It has recently been proved that for Newton or Yukawa-type two body interac- 
tions (i.e. VF(|a:|) = |a;| ^ or ^ e^'^' in M.^) such an equation is locally well-posed 
in ff", s > 1/2, and that the solution is global in time for small initial data in L"^ 
(see [8]). Blow up has been proved in [6j[7]. 

Due to the focusing nature of the nonlinearity (attractive two-body interaction) 
there exist solitary waves solutions given by 

ip{t,x) ^e'f'^^ix) 

where ip satisfy the nonlinear eigenvalue equation 

(1.3) v— A + m^<y9 — rriLp — {W * \Lp\'^)(p — —fJ-f- 

In [11] the existence of such solutions (in the case VF(x) = |x| ^) has been proved 
provided that M < Mc, Mc being the Chandrasekhar limit mass. More precisely 
the Authors have shown the existence in H^/^{M.'^) of a radial, real-valued non 
negative minimizer (ground state) of 

(1.4) f [V^] = 1 /" i/i(v/-A + m2 -m)?/;da;- i / {\x\-^ * dx. 

with given fixed "mass-charge" M = I'i/'prfx < Mc. We call mass-critical the 
potentials W whose associated functional £ exhibits this kind of phenomenon. 

More recently in \E\ it has been proved that the ground state solution is reg- 
ular {H'^{M.^), for all s > 1/2), strictly positive and that it decays exponentially. 
Moreover the solution is unique, at least for small norm (I^)- 

Let us remark that these last results are heavily based on the specific form 
(Newton or Yukawa type) of the two body interactions in the Hartree nonlinearity. 
Indeed in these cases the estimates of the nonlinearity relies on the following facts 

• for this class of potentials one has that 

* / = (/i^ - A)- 1/ for / e 5(R3), ^ > 

47r |a;| 

• the use of a generalized Leibnitz rule for Riesz and Bessel potentials 

• the following estimate holds 

lln*H^llL=o<fii(-A)V4,|||,. 

\x\ 2 
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In [2] it has been proved an existence and regularity result for the solutions of 
(|1.3p for a wider class of nonlinearities by exploiting the relation of equation (|1.3p 
with an elliptic equation on R_|_'*'^ with a nonlinear Neumann boundary condition. 
Such a relation has been recently used to study several problems involving fractional 
powers of the laplacian (see e.g. [I] and references therein) and it is based on 
an alternative definition of the operator (|l.ip that can be described as follows. 
Given any function u e 5(R^) there is a unique function v € S{R^'^^) (here 
TB^+i ^ { (x, y) e M X I a; > }) such that 



-Av + m^v ^ in M^+^ 
v{0, y) = u{y) for y G 



Setting 

we have that the equation 



Tu{y)^-^{0,y) 



j -Aw + m'^w = in 
\w;(0,y)=ru(y) = -fH(0,y) for y e 

has the solution w{x, y) = —^{x,y). From this we have that 

T{Tu){y) = - — (0, y) = —(0, y) = (-A,« + m\m v) 

and hence = {~^y + 'm^)- 

In [2] we have studied the equation 



in 



(1.5) + ni^v = fiv + ly \vf v + a{W * \v\^)v 

where p £ {2,-^^), ^ < to is fixed , cr > (but not equal both), W € 
X'-(M^) + i°°(M^), W>0,ir> N/2), W{x) = W{\x\) ^ as |x| ^ +oo. 

The results are obtained, following the approach outlined above, by studying the 
following equivalent elliptic problem with nonlinear boundary condition 



(1.6) 



-Av + m^v = in M^+^ 



and the associated functional on i7^(M:'^^^). 

Let us point out that in [2] the I? norm of the solution is not prescribed. In 
such a case existence of a (positive, radially symmetric) solution can be proved for 
a certain class of potentials W and exponents p which is larger then the one we can 
deal with here. 

When the norm is prescribed to be M (the most relevant problem from a 
physical point of view), as in [11], then the Newton potential critical, 
in the sense that minimization of E given by (|1.4p is possible only when M < Mc 
(see theorem ll.Sp . 

The main purpose of this paper is to exploit this approach also for the problem 
of finding minimizer of the static energy 
(1.7) 

£[u] = l [ w(v/-A + to2 -TO)uda; + ^ / \u\p dx - ^ [ {W * \u\^)\u\^ dx. 

with prescribed norm, for a wider class of attractive two-body potential including 
the critical case. 
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To be more precise, we consider a class of two body potential W G i^(K^), with 
q > N. We recall that L^(M^), the weak L'^ space, is the space of all measurable 
functions / such that 

supa|{a; I |/(a;)| > a}\^^'^ < +00, 

where \E\ denotes the Lebesgue measure of a set £' C M^. Note that W(x) — \x\~^ 
does not belong to any L'-space but it belongs to L^(]R^). We say that a potential 
W is critical if G L^(M^). 
Our main result is the following 

Theorem 1.8. Let W £ Ll{R'^), q> N >2, W{y) > for all y G and such 
that 

(1.9) WiX-^y) > X'^W{y), for all A G (0, 1) and for some a > 0. 

We also assume that W{x) — W{\x\) is rotationally symmetric and that W{r) — > 
as r — > +00. 

Take r]>0, a >0 and pe [2 + ^,2 + ^ = ^] . Then 

• if rj > or = and q > N , for all M > there is a strictly positive 
minimizer u G H^/'^iM'^) of E[u\ such that J^,^ v?' = AI . 

• ( mass-critical case )ifrj = and q — N there is a critical value Mc > such 
that for alio < M < there is a strictly positive minimizer u G H^/'^{R-'^) 
of £[u\ such that /j^jv = M. 

Moreover there exists fj, > such that u is a smooth, exponentially decaying at 
infinity, solution of 



(\/— A + TO^ — m)u = —fiu — 77 \u\^ ^ u + a{W * |w|^)w 



m 



and u is radial ifW~ W{r) is a decreasing function o/r > 0. 

Remark 1.10. The nonlinear term \u\^ ^ m is a defocusing nonlinearity, the convo- 
lution term is a focusing nonlinearity. An open problem is to understand if solitons 
exists also for other ranges of p, in particular ioi 2 < p < 2 + ^ and W G . 

Remark 1.11. If T4^ G and (|1.9p holds for some a > 0, then necessarily a G 
(0, N/q]. If W{x) = l^r", then T4^ G L«, if and only if a = N/q. 

Remark 1.12. /i is a Lagrange multiplier. 

2. Preliminaries 

Let {x,y) G M X E^. We have already introduced R++^ = {{x,y) G M^+i | 
X > 0}. With we will always denote the norm of M G LP{R^+^), with ||u|| the 
norm of u G i?i(R++^) and with \v\p the norm oi v G Lp(R^). 

We recall that for all v G H\R^+^) n C(f (M^+i) 

\viO,y)fdy^[ dyf ^\v{x,y)\^dx 
Jr« J+oo ox 





<p 1 1 \v{x,y)\^ ^ 




that is 



dv , 



(2.1) H^r)\l<p\\v\\l;,\\\f^ 
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which, by Sobolev embedding, is finite for all 2 < 2{p-l) < 2(7V+ l)/((iV+ 1) - 2), 
that is 2 < p < 2«, where we have set 2» = 2iV/(A^- 1). By density of ^^(R^+i) n 
Cq"(R^+^) in H^(R^~^^) such an estimates allows us to define the trace 7(w) of v 
for all the functions v G H^{R^~^^). The inequality 

(2-2) l7WI^<Pll«ll^rP-i)ll£ll2' 

holds then for all v e iJi(K^+^). 

It is known that the traces of functions in i7i(]R^+^) belong to H^/'^{R'^) and 
that every function in H'^/'^{R^) is the trace of a function in i7i(M^+^). Then 
([^ is in fact equivalent to the well known fact that j{v) £ H^/'^{R^) ^ L«(R^) 
provided q G [2, 2"]. We also recall here that 

\\w\\l,,,_ = inf{ \\ur I u e H\R^+'), ^{u) ^w}^ f (1 + \^\) \Twm^ 

Let us also introduce the norm of the weak L'^-space as follows 

11/11,,^ = sup / \f{x)\dx 

A J A 

where 1/q + 1/r = 1 and A denotes any measurable set of finite measure \A\ (see 
e.g. |10| for more details). Now using this norm we can state the weak Young 
inequality. If g € L^(K^), / € LP{R^) and h e L''(M^) where 1 < q,p,r < +oo 
and l/q+ l/p+ l/r = 2 then 

(2-3) / / f{y)g{y- z)h{y)dydz <Cp^q^r\\g\\q,w\f\p\h\r- 

JB" JB« 

We consider the class of two-body interactions W £ L^(R^) for q > N. By 
weak Young inequality and Holder inequality we have for r = 4g/(2g-l) (e (2,2«) 
since q > N) and for all p £ {^q/{2q ~ 1), 2"] 

(2.4) / (I^H"l')kl' rfy<C||iy||,.^k|^<C||W^||,.^|u;|2"^k|p^. 
jb« 

For p = 2* we get 

(2.5) / [W*\w\^)\w\^ dy<C\\W\U,^\w\t'~^ \w\J . 

JB" 

In the (critical) case q = N this gives 

(2.6) / {W*\w\^)\w\'' dy<C\\W\\N,^.\w\l\w\l,. 

Let us point out that one cannot deduce (|2.6p from the weak Young's inequality 
(12. 3p directly, and that it is not true, in general, that L°° norm of W * \u\^ can be 
bounded by the norm of u if G L^. 

For all V € H^(R'^~^^), we consider the functional given by 

Av) = \{ll {\Vv\^+fn^\v\^)dxdy~ f m\j{v)\^ dy) 

+ - / h{v)r dy-jf {W* h{v)f) \j{vf dy. 
P Jm * JR" 

In view of (|2.2p and (|2.4I) all the terms in the functional I are well defined if 
p e (2, 2«] and W € i^(M^) with q > A^. 
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Remark that from (|2.ip with p = 2 fohows that 
(2.7) mf h{v)\^ dy <2{Tn\\v\\2)\\\7v\\2 < 1 1 {\\7v\^ + \v\^) dx dy 

showing that the quadratic part in the functional I is nonnegative. 
Moreover the following property can be easily verified 

Lemma 2.8. For u £ H^{m.'^+^), let w = 7(1*) e H^/'^(R^), w = J"(w) and 
vix, y) = ^-i(e-^V™^+M'^i) = f e-"V™=+l«l'w(^)e*«^ d^ 

JR" 

Then V £ iJi(R^+^), \\v\\ = \\w\\hi/2 , I{v) <I{u) andl{v) ^ £[w]. 

3. Minimization problem 
We consider the following minimization problem 
(3.1) I{M) ^ inf {!(?;) | v £ Mm } 

where the manifold Mm is given by 

MM^{veH\R^+')\ [ \^{vf^M} 

JR" 

Remark 3.2. The term m |7(^^)P in the functional T{v) is constant for all v £ 
Mm- The presence of such a term will allow us to show that the infimum of the 
functional I on A^^f is negative. 

Concerning the existence of a minimizer for problem p. II) we start by proving, 
in the following lemmas, boundedness from below of functional T on Mm and some 
properties of the infimum I{M). 

Lemma 3.3. The functional T is hounded from below and coercive on Mm C 
H'^{U!l^^) for all M >0ifr]>0orq>N and for all M small enough if rj ^ Q 
and q = N . 

Proof. Let us examine first the convolution term. 
If 77 > 0, from ([^ and |7(u)|2 = M we have 

(3.4) 0</ {W*\^{u)\^)\^{u)\' <C\\W\\,^Mu)\T^\l{u)\f^ 

= C\\W\\g^^M^-^ Hu)\^ . 

Since q(^-2) ^ P t)y assumption, this is enough to prove coercivity if 77 > 0. 
Indeed we have in such a case that 

An) >\\\ur- \mM + C, \^{u)\l ~ C2 \l{u)\f^ > ^^1^ - C3. 

In case 77 = we deduce from (|2.6p and |7(u)l2« < C\\u\\ that 
I{u) > \\uf - mM - C||M^||,,^A/2-w/9||^||2Ar/9 

It is then clear that the functional is bounded below and coercive whenever q > N 
and, in case g = iV, if ||iy|lAr,^M is small enough. □ 

Lemma 3.5. I{M) < for all M > 0. 
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Proof. Take any function u e Co°°(M^), \u\2 = M, and let w{x,y) = e-™^u(y). 
Then 



I{M) = inf I{v) < I{w) 



N + l 

+ 



TO 



|ur dy + G{u) 



^[ \ufdy+^[ \S/yu\'dy+^f \u\'dy-^[ \uf dy + G{u) 



1 

4to 



|Vj,ur dy + G'(u) 



where 



\u\^ dy^ 



{W *\uY)\uY dy 



P Jv.« ' ' ' 4 

Take now, for A > 0, u\{y) = A^/^m(A?/) and w\{x,y) — e~"^^ux{y) G Mm for all 
A > 0. We find that 



I(M) < inf Z(wa) 

A>0 



< inf 

Ae(oa) 

< inf 
Ae(oa) 



1 

4m 
A^ 

4to 



\\7yUX 



,2 , 



2 ?7A^(§-i) 



"A 



(l¥H"A|')|liA|' 



rA" 



{W *\u\'')\u\^ 



and since q;<7V(| — l)<2we have that the infimum is negative. 



□ 



Lemma 3.6. For all M > and /S e (0,M) we have that I (M) < I{M - jS) + I{f3). 
Moreover ^^^P is a concave function of M and hence I{M) is a continuous function 
ofM. 

Proof. The subadditivity is a consequence of the fact that for all > 1 

(3.7) I{9M) < 9I{M) which implies ^/(A/) < I{M/0). 

6 

Indeed, taking di = ^ and 02 = jjz^ we have that 

/(M) = A/(M) + ^^I{M) < + liM - P) 

To prove that p.7p holds, we remark that for all i; G Mm and A = 6*^/^ > 1 we 
have, thanks to (12.71) 



I{\v) 



A2 



(I Vi'l'^ + c?i/ — TO / |7(i;)|'^ dy] 



N + l 
+ 



+ — biv)f dy-— (W. |7Mr) |7(«)r dy < \'I{v) 



P Jr« 
Hence, since /(M) < 

I{dM) = inf I{v) = inf I(6li/2^) 

|7(^')l2=eM \iiv)\^=M 



< 0^ inf I{v) = 6|2/(M) < 6'/(M) < /(M) 

|7(t,)l2=M 



To prove the concavity of -^^^ , we remark that 
- ' inf . inf 
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We now show that, for aU u e A^i, Af i-> Mu) /M is a concave function of M. 
This will immediately prove that I{M)/M is a concave fmiction. 
Since 

]-{(( {\Wv\^ + m^v^)dxdy~ f m\^{v)f dy) 



I{^/Mv) 
M 



It is then immediate to check that the second derivative with respect to the 
variable M is negative for all Af > when p/2 < 2 and that the function is linear 
when p = A (namely the critical exponent for = 2). □ 

We are now ready to prove existence of a minimizer for the functional I on Mm- 
Proposition 3.8. For every M > there is a function u G H^iM.^^^) such that 

{l{u) = I{M) 
1/m" l7(")l' dy = M 
i.e. a minimizer for I in Mm- 

Proof. Let <Z Mm be a minimizing sequence. Follows from lemma 12.81 that 

also the sequence 

Vr.{x,y) = F-\e-'^^^-'+\-\' niiun))) 

is a minimizing one. From lemma [3751 we deduce that w„ is bounded in {U.^'^^) 

and that Wn = 7(w„) — ^{un) is bounded in H^/'^iM.^) and |wn|^ dy = M. 
We will now use the concentration-compactness method of P.L. Lions [ 12] . 
Namely, one of the following cases must occur 

vanishing: for all i? > 

lim sup / l^nl^ dy = 0; 



dichotomy: for a subsequence {nk] 



lim lim sup / |^ dy = a G (0, Af); 

compactness: for all e > there is i? > 0, a sequence {yk} and a subsequence 
{wrik} such that 



/ 



|w„J^ dy>M- e. 



'Vk+BR 

Following the usual strategy we will show that vanishing and dichotomy cannot 
occur. 

Lemma 3.9. // vanishing occurs, then 

iW*\w„\'')\wrf dy^O. 

r 

Proof of lemma lKR Take any S > and R> 0. Let define Ws — Wl[w>5} and 

(lyl) = {Ws{\y\) - R)+hiyi<R} + Ws{\y\)lnyi>H}, 

where is the characteristic function of the set A . Then it easy to check that 
W e Ll{R^) implies that Ws £ L%R^) for any s e [l,q) and moreover that 
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\Wf\s ^ as i? +00 for any S > 0. Let us define also Tf = Ws - Wf. It is 
clear that 

0<iW-Ws){\y\)<S, 0<Tfi\y\)<R Vy e 

Then for any given 5 > and R > and for some s > N/2 (which implies that 
2 < 4s/ {2s — 1) < 2N/{N — 1)) we get from the Young inequality (also taking 
into account that by Sobolev embedding the sequence {wn} is bounded in for 

pe[2,2N/{N-l)] ) 

{W*\Wnf)\Wn\'' < [ iiW-Ws)*\Wnf)\Wn\''+ [ (Wf*\Wnf)\Wn\'' 



(Tf*\Wnn\w„ 

f 

<6\Wn\l+\W^\s\Wn\l,H2s-l)+R jj \Wn{y)\^ \Wn{z)\^ l\z-y\<Rdy dz 



< (5Af2 + C\W^l + RM sup j \wn\^ dy. 



Now, letting first n +oo, then R +co and finally (5 — > 0+ we conclude the 
proof of the lemma. □ 

Lemma 3.10. // dichotomy occurs, then for any a £ (0, M) we have 

I{M) > I{a)+I{M -a). 

Proof of lemma [S.l(A If dichotomy occurs then there is a sequence {nfe} C N such 
that for any e > there exists R > and a sequence {zk} C such that 



lim / \wnk\^ dy e {a - e,a + e). 



k^+oo Jz, + Bn 

Let define lik — Wn^. (• + Zjt) and 

so that {ilk} is a minimizing sequence for I on Mm such that 
lim / \j{uk)\'^ dy £ {a- e,a + e). 



Since {ufc} is a bounded sequence in i/^(M^^^) then Uk ^ u weakly in i/^(M:!j^^^) 
and Wk = ^{uk) — > w = 7(w) weakly in H^/^ and strongly in L^^^iW^) for p S 
[2, 2N/{N - 1)). Hence for all e > there is i? > such that 



and 



\^{u)\^ dy ^ lim / \^{uk)\^ dy £ {a - e,a + e). 



dy = \\m / |7(u)|^ = a. 



We set Vk = Uk — u and /3/c = J^^ \7{vk)\^ dy, by weak convergence in of the 
sequence {^(uk)} we get limfe_j.+oo Pk = M - a. 
Now we claim that 

/(A-f) = lim I(wfc)=T(M)+ lim X(ufc) > /(a) + lim /(/3fc) 



and by the continuity of the function /, as stated in lemma 13761 the lemma follows. 
Now let us prove the claim. We will show that 

lim (X(ufc) - I{vk)) I{u) 
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Indeed by weak convergence in H^{R^'^^) we immediately get 



k->- + 00 \ J J^N + l + 1 J + 1 



and by the Brezis-Lieb lemma 

lim ( f |7(ufe)r- / h{vk)\A = / i7(«)r 

for 2 <p < 2N/{N- 1). 

Hence we have to investigate the last nonlinear term. We will show in the 
Appendix A that 

lim ([ {W*\wk\^)\wk\^- [ {W*h{vk)\^)\j{vk)A ^ f {W*\w\^)\w\\ 

from which the claim follows. □ 

Finally, since we have ruled out both vanishing and dichotomy, then we may 
conclude that indeed compactness occurs, namely that for all e > there is i? > 0, 
a sequence {j/fc} and a subsequence {wn^} such that 



Jvk+BR 



Wnf dy>M-e. 



So let us define as before Wk = {■ + Vk) and 



Then Uk is a minimizing sequence for X on A4m such that 

|7(ufc)l'>M-e. 



Since {uk} is a bounded sequence in H^{M.^'^^) then Uk ^ u weakly in H^{M.%+^) 
and Wk = "f{uk) w = "f{u) weakly in H^^"^ and strongly in Lf^^(R^) for p € 
[2, 2N/{N - 1)). As in the proof of lemma [XTUl we deduce that \l{u)f = M. 
Moreover we claim that as A; — )• +oo 

{W *\wk\^)\wk\^ ^ I {W*w^)w^. 



Indeed, by the weak Young inequality and by Holder inequality we have 



{W *wl)wl - / {W*w^)w^ 



< I {W*{wl+w^))\wl-w-'\ 



< C\\W\\,,^\wi + W'\s\wi -W'U< C\wk - W\2s ^ 

since 2 < 2s = 4g/(2g - 1) < 27V/(A^ - 1). 

Hence finally by weakly lower semicontinuity of and norms (the positive 
terms of the functional I) we may conclude that 

I{u) < liminfZ(ufc) I{M) 
which implies the m is a minimizer for T in Mm- D 
Now we collect all the results obtained to conclude the proof of Theorem 11.81 
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Proof of Theorem \1.8\ By proposition 13.81 there exists a function u € H^{W^^^) 
which minimizes T in Mm- Therefore u can always be assumed nonnegative and, 
by lemma [2781 of the form 



u{x,y) = J^-^e-^V^'+l-l'j-H) 

where w = 7(m) G iJi/2(R^). 

If Vl^ is a nonincreasing radial function, then w can be assumed to be a radial 
nonincreasing function. Indeed let w* be the spherically symmetric decreasing 
rearrangement of w and define 



Then I{u*) = £[w*] (also this follows from lemma 12. 8p . We can then use the 
properties of the spherically symmetric decreasing rearrangement, namely 

(i) w* is a nonnegative, radial function; 

(ii) w e LP(R^) implies w* G LP(M^) and \w*\p = \w\p; 

(iii) symmetric decreasing rearrangement decreases kinetic energy (Lemma 7.17 
hi ,lQj), that is 



'w*{\/—A + m? — m)w* dy < / w{\/—A + m? — m)w dy; 

(iv) Riesz's rearrangement inequality (see Theorem 3.7 in [10 )), namely 

{W *\w*\^)\w*\^dy> I {W * \w\^)\w\^ dy 

if W{y) — W*{\y\) (in particular if W is radial and nonincreasing) 
to deduce that 

I{u*) = £[w*] < £[w] = I{u) = I{M). 

Moreover, by the theory of Lagrange multipliers, any minimizer u G {M.^'^^) 
of the functional I on m is such that 

(3.11) // {W u\7 w + m? uw) dx dy — I mj[u)j{w) dy + fi / ^{u)^{w)dy 
JJr^+^ Jr« Jr« 

+ rj |7(ii)|^ ^(u)^(w) dy — a j {W *\^{u)\^)^{u)^{w) dy = Q 
Js." Jr" 

for allw e H\R'1+^), i.e. M is a weak solution of the following nonlinear Neumann 
boundary condition problem 



(3.12) 



-Am + m'^u = in M^+^ 



,—^+liu = mu — ri\u\^ u + a{W * \u\'^)u on — i^ii^^ 

for some Lagrange multiplier /i G M. To prove that /i > we take w = u in l3.11l to 
get 

0= // {\Wu\^ + mj^ \u\^) dx dy — / m\^{u)\^dy + ^ / \j{u)\^ dy 
J7r~+i Jr« Jr« 

+ V [ l7(")r dy~a [ {W * \-f{u)f) dy 

JR« JR« 

,2 . 2. 



2I(m) + M / |7(w)r rfy + ^(1 - -) / l7(")r dy 

JR« P JR« 

-| / {W*\jiu)\^)\j{u)f dy. 

^ . UN 
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Since T{u) < we have in particular that 

^ / \j{u)fdy<j I {W^\^{uf)\^{u)\^ dy 
and hence, since p < 2N/ {N — 1) < 4, for N > 2, we get 
M / dy 

= -21{u) - ry(l - -) / \j{u)f + | / {W * \j{u)\') \j{u)f dy 

>vi--l)[ \liurdy>0. 



P 

Finally the regularity, the strictly positivity and the exponential decay at infinity 
of the weak nonnegative solutions of (|3.12p follow straightforwards from Theorems 
3.14 and 5.1 in [2]. □ 



4. Appendix A 



We prove that 



\{W * wj{vk))wj{vk)\ + \iW *j{vk) )w^\+ I * W7(-Dfe))u;^| + 

R« JR« 



\{W * j{vk) )wj{vk)\ ^ a.s k ^ +00. 

as claimed in the proof of lemma [5. 101 Indeed we have the following result. 

Lemma 4.1. For any w G and for sequences {/n,<7n,/in} bounded in 

H^/^(E^) and such that fn-^Oin Lf^^ we have 

{W * \fngn\)\whn\ -i' asn-^+oo. 



Proof. It is convenient to introduce for any given 5 > and R > 0, Ws = WIw>s 
and 

Wi'iy) = {Ws - i?)+I|.„|<fl + Wsliyi>H. 

Then for W e Ll{R^) we have Ws € LP{R^) for any p e [l,q) and moreover 
that I W/^lp — >■ as i? -> +oo for any S > 0. Let introduce again also Tf — Ws—Wf-. 
Note that supp Vf C Br and <Tf < R. 

From Young inequality (with p = N/2, r = 2p/{2p - 1) N/{N - 1)), Holder 
inequality and Sobolev embedding we have 



{W ^\fngn\)\wh^\ 

<[ {{W ~Ws)*\fngn\)\wh,,\+ f (Ws^'^lf^gnDlwhnl 

7r« Jr« 

(4.2) + / (Ff H/n5n|)k/ln| 

JR« 

<S\fngn\l\'whn\l + \Ws^\N/2\fngn\r\'whn\r+ / (Ff * | /„.g„ | ) | w/l„ | 



< Ci6 + \Ws''\n/2) + / (rf- * |/„<?„|)k/i„|. 

First of all we claim that 

(rf * ^ asn^+oo. 
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Indeed, for any e > we fix i?i > such that |Ii{n\BjW|2 < e, where Bi = Br^. 
We introduce also R2 = Ri + R and B2 = Bn^ so that for any y E Bi and 
z G \ B2, we have \z-y\>R and hence Tf (z -y) = 0. 

Now we estimate the term as follows 

/ {Tf*\fngn\)\wK\= f {Tf*{lBjfngn\))\wK\+f {Vf * \Ugn\)\wh„\ 

< R\lB2fng 

< R\gn\2\hn\2i\lBjn\2\w\2 + i? | /„ 1 2 1%" \i3i U;| 2 ) 
<Ci?(|lB,/„|2+|lR«\B,w|2) 

and since /„ — as n — >■ +00 in L^{B2) the claim is proved. 

Then we conclude the proof of the lemma sending first n -> +00 , then R ^ +00 
and finally (5 ^ in g21). □ 
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